Hyperspectral  imaging  of  cuttlefish  camouflage 
indicates  good  color  match  in  the  eyes 
of  fish  predators 
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Camouflage  is  a  widespread  phenomenon  throughout  nature  and 
an  important  antipredator  tactic  in  natural  selection.  Many  visual 
predators  have  keen  color  perception,  and  thus  camouflage 
patterns  should  provide  some  degree  of  color  matching  in  addition 
to  other  visual  factors  such  as  pattern,  contrast,  and  texture. 
Quantifying  camouflage  effectiveness  in  the  eyes  of  the  predator 
is  a  challenge  from  the  perspectives  of  both  biology  and  optical 
imaging  technology.  Here  we  take  advantage  of  hyperspectral 
imaging  (HSI),  which  records  full-spectrum  light  data,  to  simulta¬ 
neously  visualize  color  match  and  pattern  match  in  the  spectral 
and  the  spatial  domains,  respectively.  Cuttlefish  can  dynamically 
camouflage  themselves  on  any  natural  substrate  and,  despite  their 
colorblindness,  produce  body  patterns  that  appear  to  have  high- 
fidelity  color  matches  to  the  substrate  when  viewed  directly  by 
humans  or  with  RGB  images.  Live  camouflaged  cuttlefish  on  nat¬ 
ural  backgrounds  were  imaged  using  HSI,  and  subsequent  spectral 
analysis  revealed  that  most  reflectance  spectra  of  individual  cut¬ 
tlefish  and  substrates  were  similar,  rendering  the  color  match  pos¬ 
sible.  Modeling  color  vision  of  potential  di-  and  trichromatic  fish 
predators  of  cuttlefish  corroborated  the  spectral  match  analysis 
and  demonstrated  that  camouflaged  cuttlefish  show  good  color 
match  as  well  as  pattern  match  in  the  eyes  of  fish  predators.  These 
findings  (/)  indicate  the  strong  potential  of  HSI  technology  to  en¬ 
hance  studies  of  biological  coloration  and  (#7)  provide  supporting 
evidence  that  cuttlefish  can  produce  color-coordinated  camou¬ 
flage  on  natural  substrates  despite  lacking  color  vision. 

Sepia  officinalis  |  skin  coloration  |  defense  |  predator-prey  | 
visual  perception 

Animal  coloration  plays  a  key  role  in  many  facets  of  natural 
and  sexual  selection  (1).  Camouflage  is  a  widespread  phe¬ 
nomenon  throughout  nature  and  an  important  antipredator 
tactic  (2,  3).  Camouflaged  animals  use  diverse  body  patterns  to 
make  detection  or  recognition  more  difficult  (4).  However,  many 
visual  predators  have  keen  color  vision,  and  thus  camouflage 
should  provide  some  degree  of  color  matching  in  addition  to 
other  visual  factors  such  as  pattern,  contrast,  and  texture. 

Objective  assessment  of  color  signals  in  the  eyes  of  the 
receivers  (using  point  source  spectrometers)  has  greatly  ad¬ 
vanced  our  understanding  of  visual  communication  and  camou¬ 
flage  (5-12).  Previous  investigations  of  camouflage  using  image 
analysis  (including  spatial  filtering  and  edge  detection)  provided 
insights  into  the  mechanisms  of  visual  perception  of  predators 
(13,  14),  yet  these  studies  suffer  from  the  inability  to  assess  the 
effectiveness  of  camouflage  in  the  visual  space  of  predators  (15). 
Recent  studies  using  digital  photography  in  conjunction  with 
color  space  modeling  have  examined  body  coloration  in  both 
spatial  and  spectral  domains  (16-20).  In  the  present  study,  we 
exploit  unique  imaging  technology  [hyperspectral  imaging  (HSI)] 
(Fig.  L4)  to  simultaneously  obtain  spatial  and  spectral  data  from 
camouflaged  cuttlefish  expressing  disruptive,  mottle,  and  uni¬ 
form  body  patterns  on  natural  backgrounds  (Fig.  1  B-D).  The 


hyperspectral  image  is  typically  captured  by  scanning  the  2D 
sensor  either  spectrally  or  spatially  in  the  third  dimension  to 
acquire  the  3D  data  cube  of  which  the  z  axis  normally  represents 
the  reflectance  spectrum  of  the  corresponding  point  in  the  scene. 

Camouflage  is  the  primary  defense  of  coleoid  cephalopods 
(octopus,  squid,  and  cuttlefish)  and  their  rapidly  adaptable  body 
patterning  system  is  among  the  most  sophisticated  in  the  animal 
kingdom  (21-23).  The  expression  of  camouflaged  body  patterns 
in  cuttlefish  is  a  visually  driven  behavior.  Previous  studies  have 
shown  that  certain  background  variables — such  as  brightness, 
contrast,  edge,  and  size  of  objects — are  essential  for  eliciting 
camouflaged  body  patterns  (24-28).  However,  most  cephalo¬ 
pods,  including  the  cuttlefish  under  study,  lack  color  perception 
(29-32);  thus  the  vexing  question  of  how  they  achieve  colorblind 
camouflage  still  remains. 

The  goal  of  the  present  study  was  to  analyze  the  spectral 
properties  of  cuttlefish  and  some  natural  substrates  in  the  entire 
image,  which  allows  us  to  directly  visualize  the  spectral  differ¬ 
ences  and  to  examine  color  matching  between  animal  and  back¬ 
ground.  More  importantly,  by  modeling  a  few  hypothetical  visual 
systems  of  their  predators,  we  can  generate  the  camouflage  views 
through  the  eyes  of  fish  predators  with  either  di-  or  trichromatic 
vision  (Fig.  1).  This  approach  provides  a  methodology  to  eval¬ 
uate  camouflage  body  patterns  in  the  luminance  and  chromatic 
channels  of  the  receivers.  In  our  unique  approach,  color  and 
pattern  matching  in  camouflaged  animals  is  objectively  visu¬ 
alized  and  assessed  through  the  eyes  of  their  potential  predators 
using  hyperspectral  images. 

Results 

Spectral  Properties  of  Animal  Versus  Background  That  Facilitate  Color 
Match.  To  examine  whether  the  reflectance  spectra  of  certain  skin 
components  resemble  some  background  objects,  the  spectral  angle 
mapper  (SAM)  classification  analysis  of  ENVT  image  analysis 
software  (ITT  Visual  Information  Solutions)  was  performed  on  the 
HSI-generated  data  cubes  (SI  Materials  and  Methods).  Consistent 
with  our  previous  measurements  using  the  spectrometer  (33),  the 
reflectance  spectra  of  some  selected  skin  components  showed 
typical  spectral  properties  of  cuttlefish  (Figs.  S1-S3).  Curiously, 
most  reflectance  spectra  of  cuttlefish  had  a  peak  around  800  nm 
in  the  infrared  range  (IR),  whereas  natural  substrates  tested  did 
not  have  this  spectral  characteristic.  This  color  mismatch  between 
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Fig.  1.  Hyperspectral  imaging  and  modeling  of  camouflaged  cuttlefish  through  the  eyes  of  the  hypothetical  di-  and  trichromatic  fish  predators.  04)  A  three- 
dimensional  cube  of  the  hyperspectral  image  (HSI)  data,  in  which  the  x  and  y  dimensions  are  spatial  domains  and  the  z  dimension  is  the  spectral  domain.  ( B-D ) 
Pseudocolor  images  of  cuttlefish  showing  disruptive,  mottle,  and  uniform  body  patterns  on  natural  substrates,  respectively.  (£)  The  irradiance  spectrum  /(A.)  of 
standard  daylight,  D65  (56).  (E)  The  transmission  spectra  T(X)  of  coastal  water  type  3  at  1  m  and  10  m  (36).  (G)  The  sensitivity  spectra  S(X)  of  given  cone 
photoreceptors  with  known  Xmax.  ( H )  The  reflectance  spectra  R(X)  from  the  HSI  data  are  modeled  ( Materials  and  Methods)  for  convenient  visualization 
(human  view)  and  for  analyzing  color  signals  through  the  eyes  of  the  fish  predators  (animal  view).  (Scale  bar,  2  cm.) 


animal  and  background  would  make  cuttlefish  detectable  if  the 
predators  (or  the  sensor)  had  an  infrared  capability,  but  IR  does 
not  transmit  far  in  seawater  and  is  not  thought  to  be  used  in  aquatic 
visual  systems  (34).  In  the  human  visible  wavelength  range,  how¬ 
ever,  the  reflectance  spectra  of  animal  and  some  background  areas 
are  much  alike.  Using  SAM  analysis,  we  confirmed  that  reflectance 
spectra  of  cuttlefish  randomly  resemble  the  background  spectra. 
This  result  suggests  that  the  spectral  similarity  between  animal  and 
background  may  facilitate  color  match  for  camouflage. 

Viewing  the  Color  and  Pattern  Similarities  Between  Animal  and 
Background  via  Di-  and  Trichromatic  Systems  of  Hypothetical  Fish 
Predators.  To  examine  whether  the  spectral  similarity  between 
cuttlefish  and  background  can  impede  detection  by  potential 
predators  using  their  color  vision,  we  modeled  both  di-  and  tri¬ 
chromatic  vision  systems  of  fish  predators  viewing  these  cam¬ 
ouflaged  cuttlefish  on  natural  substrates  (Fig.  1).  Whereas  the 
pseudocolor  image  gives  the  convenient  human  view  of  cuttlefish 
in  shallow  water  (Fig.  24),  the  di-  and  trichromatic  composite 
images  generated  by  combining  the  quantum  catch  images  fa¬ 
cilitate  the  visualization  of  cuttlefish  from  predators’  views  (Fig. 
2  C  and  D).  By  removing  the  luminance  information  (Fig.  2 B) 
from  these  di-  and  trichromatic  composite  images  (i.e.,  projec¬ 
ting  the  quantum  catch  images  onto  the  isoluminance  plane) 
( Materials  and  Methods),  the  isoluminant  chromatic  images 
(Fig.  2  E  and  F)  can  be  obtained  to  represent  only  the  color  in¬ 
formation  (or  hue)  remaining  in  the  scene.  Close  examination  of 


these  chromatic  images  revealed  that  most  features  were  washed 
out  and  the  overall  contrast  was  reduced  significantly.  This  result 
suggests  that  color  information  of  camouflaged  cuttlefish  in  the 
chromatic  channels  of  di-  and  trichromatic  fish  predators  is  much 
reduced.  To  further  characterize  the  chromatic  discriminability 
(AS)  of  cuttlefish  against  background  in  the  eyes  of  these  pred¬ 
ators,  the  color  contrast  images  (Fig.  2  G  and  H)  were  generated 
by  assigning  AS  between  each  pixel  and  averaged  background  in 
the  color  space  of  di-  and  trichromatic  fish  (35).  These  images 
showed  that  the  chromatic  just-noticeable  differences  (JNDs) 
between  animal  and  background  were  relatively  small  and  dis¬ 
tributed  randomly,  an  indication  of  good  color  match  for  cuttlefish. 

To  simulate  the  effect  of  color  change  with  increasing  depth  of 
water,  the  transmission  spectra  of  coastal  water  type  3  (36)  at  1  m 
and  10  m  were  included  in  the  model  (Fig.  IF).  Similar  to  the 
images  in  Fig.  2,  color  information  and  chromatic  discrimina¬ 
bility  of  camouflaged  cuttlefish  in  the  eyes  of  di-  and  trichromatic 
fish  predators  were  also  reduced  significantly  at  1  m  and  10  m 
depth  (Figs.  S4  and  S5).  These  results  suggest  that — despite  the 
von  Kries  color  constancy  mechanism  for  each  receptor  (Eq.  2) 
that  was  implemented  in  the  model — the  chromatic  information 
of  camouflaged  cuttlefish  was  still  further  reduced  with  water 
depth,  which  makes  the  visual  detection  by  potential  predators 
using  their  color  vision  even  more  difficult.  A  similar  trend  was 
also  observed  for  cuttlefish  in  different  body  patterns  (Figs.  S6- 
Sll).  Quantitative  analyses  further  substantiated  that  chromatic 
information  of  camouflaged  cuttlefish  on  all  three  substrate  types 
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Fig.  2.  Color  matching  of  camouflaged  cuttlefish  when  viewed  by  hypothetical  di-  and  trichromatic  fish  predators.  ( A )  The  pseudocolor  image  for  simulating 
the  human  view  of  the  cuttlefish  at  near  surface.  This  composite  image  was  formed  by  using  three  frames  (650,  550,  and  450  nm)  of  the  HSI  data  multiplied  by 
the  irradiance  spectrum  (Fig.  IE).  ( B )  The  monochromatic  image  for  representing  the  luminance  information  of  di-  and  trichromatic  predators.  (C and  D)  The 
composite  images  for  simulating  the  di-  and  trichromatic  predator  views  of  the  cuttlefish,  respectively.  (E  and  E)  The  isoluminant  chromatic  images  for 
representing  the  color  information  of  di-  and  trichromatic  predators.  (G  and  H)  The  color  contrast  images  showing  just-noticeable  differences  (JNDs)  of  color 
signals  between  animal  and  background  when  viewed  by  di-  and  trichromatic  predators  ( Materials  and  Methods).  The  scales  indicate  JNDs.  (Scale  bar,  2  cm.) 


was  much  less  than  that  in  the  luminance  channel  (Fig.  SI 2). 
Finally,  to  emphasize  the  importance  of  chromatic  information  in 
certain  visual  tasks,  we  applied  the  same  modeling  on  the  standard 
test  plate  for  human  red-green  colorblindness  (Fig.  3),  illustrating 
how  the  number  5  can  be  readily  detected  only  in  the  isoluminant 
trichromatic  image,  thus  highlighting  the  importance  of  color  in¬ 
formation  for  pattern  recognition.  Taken  together,  our  evidence 
demonstrates  that  the  spectral  similarity  between  cuttlefish  and 
background  can  drastically  reduce  the  effectiveness  of  color  dis¬ 
crimination  by  their  potential  predators  with  keen  color  vision. 

To  take  advantage  of  the  HSI  data,  we  compared  the  body 
pattern  of  animal  and  the  texture  pattern  of  background  in  the 
luminance  and  chromatic  channels,  using  the  method  we  term 
“granularity  analysis.”  It  is  apparent  that  the  contrast  (the  ampli¬ 
tude  of  the  curve)  and  the  spatial  scale  (the  shape  of  the  curve)  of 
animal  and  background  were  much  alike  in  all  three  substrate 
types  (Fig.  4),  suggesting  a  good  general  background  resemblance 
by  these  camouflaged  cuttlefish.  The  observation  that  the  contrast 
of  the  monochromatic  images  was  much  higher  than  that  of  the  di- 
and  trichromatic  images  also  corroborates  that  the  contrast  in¬ 
formation  of  cuttlefish  largely  resides  in  the  luminance  channel  of 
the  fish  predators,  not  in  their  chromatic  channels.  Thus,  in  ad¬ 
dition  to  good  color  match,  camouflaged  cuttlefish  also  show  good 
pattern  match  in  the  eyes  of  di-  and  trichromatic  fish. 

Discussion 

Camouflage  exploits  the  perceptual  capabilities  of  predators 
mainly  by  hindering  detection  or  recognition  of  the  prey  (15).  A 
good  deal  of  recent  progress  has  been  achieved  in  uncovering 
some  of  the  mechanisms  and  functions  of  camouflage  in  various 
taxa  (4).  Color  plays  one  of  the  key  roles  in  camouflage  but  it  has 
proved  intractable  to  acquire  images  and  spectra  simultaneously 
to  provide  a  fuller  representation  of  the  light  data  available  in 
any  scene  at  the  exact  time  of  exposure.  Here  we  show  that 
a  unique  technology — HSI — provides  a  way  to  take  advantage  of 
digital  imagery  in  such  a  manner  that  many  spectra  can  be 
obtained  in  every  pixel  of  the  image,  which  then  allows  highly 
flexible  postanalyses  to  tailor  the  light  and  pattern  information  to 
the  visual  system  of  different  predators.  This  is  a  superior  sci¬ 
entific  methodology  compared  with  using  RGB  digital  cameras, 


which  are  designed  for  human  trichromatic  vision.  However,  some 
practical  and  analytical  issues  still  require  refinement  before  HSI 
can  come  into  common  use  in  vision  research  and  ecology. 

Hyperspectral  Imaging  Adds  a  Unique  Dimension  to  Quantifying  Ani¬ 
mal  Camouflage  in  the  Eyes  of  Predators.  To  understand  the  adap¬ 
tive  features  of  the  visual  system  in  animal  communication,  it  is 
crucial  to  be  able  to  measure  the  visual  signals  (from  the  sender) 
as  seen  by  the  eyes  of  the  beholder  (the  receiver).  In  the  past, 


Fig.  3.  Illustration  of  the  importance  of  color  information  in  pattern  rec¬ 
ognition.  (A)  The  Ishihara  colorblind  test  plate  of  number  5.  ( B )  The  lumi¬ 
nance  information  of  the  plate.  This  information  was  obtained  by  averaging 
its  RGB  frames  directly.  (C  and  D)  The  chromatic  information  of  the  plate 
under  di-  and  trichromatic  vision,  respectively.  The  original  RGB  frames  were 
treated  as  the  quantum  catch  images  of  di-  or  trichromatic  predators  (Fig. 
IE/),  and  the  isoluminant  chromatic  images  were  computed  as  those  depic¬ 
ted  in  Fig.  2  E  and  E. 
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Fig.  4.  Pattern  matching  of  camouflaged  cuttlefish  versus  background  when  viewed  by  hypothetical  di-  and  trichromatic  fish  predators.  (A-C)  Average 
granularity  spectra  of  cuttlefish  showing  disruptive,  mottle,  and  uniform  body  patterns,  respectively,  and  of  their  corresponding  substrates  at  near  surface. 
Granularity  spectra  of  animals  and  backgrounds  were  obtained  from  images  in  the  luminance  and  chromatic  channels  of  di-  and  trichromatic  predators  (e.g., 
Fig.  2  B,  E,  and  F).  The  amplitude  and  shape  of  these  curves  reflect  high/low  contrast  and  coarse/fine  scale  of  the  body  patterns,  respectively. 


many  studies  used  spectrometry  to  acquire  chromatic  infor¬ 
mation  of  the  signals,  i.e.,  the  reflectance  spectra  of  the  color 
patches  on  the  animal  or  the  plant  (5,  8,  37,  38).  By  mapping  the 
spectral  data  onto  the  color  space  of  a  studied  animal  species  on 
the  basis  of  the  estimated  photon  catches  for  known  photore¬ 
ceptor  types,  insights  can  be  gained  about  the  strength  of  color 
signals  from  the  viewpoint  of  the  receiver  (7,  9-11,  39,  40). 
However,  conventional  spectrometers  offer  only  point  samples, 
making  the  study  of  patterns  (spatial  relationship  of  sampled 
points)  in  their  context  difficult,  if  not  impossible. 

The  potentially  optimal  solution  for  characterization  of  both 
spatial  and  spectral  information  in  studying  animal  communi¬ 
cation  is  the  use  of  multispectral  or  hyperspectral  imaging  sys¬ 
tems  (but  see  a  few  exceptions  in  refs.  16-20).  In  the  last  decade, 
this  multiband  imaging  system,  originally  designed  for  remote 
sensing,  has  been  applied  largely  in  studying  human  color  vision 
(41-46)  and  animal  color  communication  (47).  In  the  present 
camouflage  study,  the  use  of  HSI  allows  us  to  visualize  the  spectral 
difference  and  to  examine  color  and  pattern  matches  between 
animal  and  background  through  the  eyes  of  the  fish  predators. 
This  system  provides  a  unique  way  to  evaluate  camouflage  body 
patterns  in  spatial  and  spectral  domains  simultaneously.  Despite 
some  drawbacks  of  HSI  (e.g.,  long  exposure  time,  relatively  large 
size,  and  cost),  future  technology  to  improve  scanning  speed, 
camera  sensitivity,  and  resolution  should  eventually  allow  HSI 
instruments  to  obtain  not  only  spatial  and  spectral  informa¬ 
tion,  but  also  temporal  information  at  real  time.  These  four¬ 
dimensional  image  data  ( x ,  y,  X,  t)  will  ultimately  change  the 
way  we  study  visual  communication  of  animals  in  their  nat¬ 
ural  habitats. 

How  Do  Colorblind  Cuttlefish  Achieve  Color  Match  and  Hide  in  Plain 
Sight  of  Their  Visual  Predators?  Most  animals  have  a  fixed  or  slowly 
changing  camouflage  pattern,  but  cephalopods  can  rapidly  adapt 
their  skin  pattern  for  appropriate  camouflage  against  a  stagger¬ 
ing  array  of  visual  backgrounds  (21-23).  Although  how  cuttlefish 
detect  visual  features  on  the  substrates  and  deploy  appropriate 
body  patterns  to  conceal  themselves  has  been  studied  extensively 
in  the  laboratory  (see  review  in  refs.  22  and  48),  little  is  known 
about  how  cuttlefish  deceive  their  common  visual  predators  such 
as  teleost  fishes,  diving  birds,  and  marine  mammals,  which  typi¬ 
cally  have  di-,  tri,  or  even  tetrachromatic  vision,  in  plain  sight. 

The  color-changing  abilities  of  cephalopods  have  been  ap¬ 
preciated  since  Aristotle’s  time.  Although  this  topic  has  received 
much  attention  in  the  past  (e.g.,  refs.  21  and  49),  no  quantitative 
assessment  has  been  made  to  examine  the  color  match  between 
animal  and  background.  In  the  present  study,  we  used  HSI  to 
simultaneously  acquire  spatial  and  spectral  information  of  the 
common  European  cuttlefish  (Sepia  officinalis)  on  a  small  range 
of  natural  substrates  with  the  intention  of  evoking  the  three  main 


camouflage  body  pattern  types  (disruptive,  mottle,  and  uniform) 
(23).  By  comparing  the  spectral  similarity  across  the  spatial  do¬ 
main,  and  modeling  the  views  through  the  di-  or  trichromatic 
vision  systems  of  potential  predators,  we  demonstrated  that  col¬ 
orblind  cuttlefish  can — on  certain  backgrounds — achieve  high- 
fidelity  color  match  for  camouflage.  It  is  also  noteworthy  that  the 
cuttlefish’s  white  square  stands  out  with  higher  contrast  in  di- 
and  trichromatic  images  of  potential  fish  predators  (Fig.  2  C  and 
D);  this  is  a  tenet  of  disruptive  coloration  proposed  by  Cott  (2) 
and  noted  in  cephalopods  recently  (48). 

It  is  intriguing  that,  despite  their  sophisticated  color  and  pattern 
change,  cuttlefish  are  colorblind  (21,  29-32).  Although  our  pre¬ 
vious  observations  and  the  present  study  suggest  that  the  spectral 
properties  of  some  natural  substrates  and  cuttlefish  skin  colors  are 
similar  (33),  and  thus  the  high-fidelity  color  match  for  camouflage 
is  achievable  in  the  eyes  of  di-  or  trichromatic  fish  predators,  how 
exactly  they  match  their  skin  coloration  to  more  colorfully  diverse 
habitats  (mostly  shallow  water  environments)  is  still  elusive. 

In  addition  to  chromatophores,  cuttlefish  have  various  struc¬ 
tural  reflectors  (leucophores  and  iridophores)  lying  subjacent  to 
chromatophores,  and  these  complement  color  production  in  the 
skin  (50).  By  retracting  the  chromatophores  and  thus  revealing 
the  underlying  leucophores,  the  skin  can  reflect  some  of  the 
ambient  light,  which  may  aid  both  wavelength  and  intensity 
matching  (51).  Furthermore,  the  iridophores  could  also  alter  the 
appearance  of  chromatophores  by  reflecting  specific  wavelengths 
(especially  shorter  wavelengths  that  the  pigmented  chromato¬ 
phores  cannot  produce)  through  thin-film  interference  (52,  53). 
Given  the  rich  repertoire  of  cuttlefish  skin  components  (chro¬ 
matophores,  leucophores,  and  iridophores),  it  is  likely  that  color 
resemblance  by  cuttlefish  is  also  achieved  even  in  the  most  spec¬ 
trally  rich  environments  known  (e.g.,  kelp  forests  and  coral  reefs). 

A  recent  discovery  suggests  distributed  sensing  of  light  by  the 
skin  of  cuttlefish.  Mathger  et  al.  (54)  found  opsin  transcripts 
(mRNA  expression)  in  the  fin  and  ventral  skin  of  S.  officinalis. 
The  single  visual  pigment  in  the  cuttlefish  eye  is  an  opsin  with 
Knax  =  492  nm.  The  opsin  expressed  in  the  fin  and  ventral  skin  is 
identical  to  that  of  the  retina;  thus  color  discrimination  by  the 
skin  opsin  is  unlikely  because  this  opsin  still  renders  the  animal 
“monochromatic.”  However,  this  finding  provides  a  possible 
mechanism  for  distributed  light  sensing  in  the  skin  to  adjust 
overall  brightness  match  to  the  immediate  background.  Future 
research  might  find  skin  opsins  tuned  to  other  wavelengths,  which 
would  introduce  the  possibility  of  color  sensing  in  the  skin. 

Materials  and  Methods 

Animals  and  Experimental  Setup.  Young  cuttlefish  (S.  officinalis  L.)  ranging  in 
size  from  4  to  6  cm  mantle  length  (ML),  were  used  in  this  study.  Each  animal 
was  placed  in  a  tank  (55  x  40  x  15  cm)  with  flowing  seawater  and  restricted 
to  a  cylindrical  arena  (14.3  cm  diameter  and  4.9  cm  height)  where  three 
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types  of  natural  substrates  were  presented  on  the  floor  (the  wall  was  uni¬ 
form  gray  or  uniform  white).  These  natural  substrates  are  known  to  evoke 
the  three  major  body  patterns  (23,  55),  namely  disruptive  (mixture  of 
differently  colored  rocks),  mottle  (gravel),  and  uniform/stipple  (sand).  A 
high-intensity  lamp  for  faster  hyperspectral  image  scanning,  the  Tungsten 
fluorescent  solar  simulator,  was  used  to  illuminate  the  arena  evenly  via 
a  diffuser.  The  output  of  this  light  source  (8.2  A)  was  1,500  lux,  which  en¬ 
abled  shorter  exposure  times  for  scanning.  Once  the  animal  acclimated,  the 
hyperspectral  images  were  taken  by  the  HyperScan  VNIR  system  (Opto- 
Knowledge  Systems)  mounted  148  cm  above  the  arena.  There  were  two 
animals  used  per  substrate  in  the  experiment,  and  some  animals  were  re¬ 
peatedly  used  for  different  substrates.  See  SI  Materials  and  Methods  for 
details  of  the  hyperspectral  imaging  system. 

Hyperspectral  Imaging  System  and  Image  Acquisition.  The  TE-cooled,  low- 
noise  CCD  camera  of  the  HyperScan  VNIR  system  has  a  spatial  resolution  of 
696  pixels  in  the  x  dimension  and  a  total  of  412  spectral  channels  in  the  z 
dimension  (at  a  1.3-nm  interval,  from  368.9  nm  to  900.7  nm;  FWHM  2.0  nm, 
25-pm  slit).  Using  the  push-broom  imaging  mode  (scanning  resolution  5 
lirad),  this  system  can  acquire  580  pixels  in  the  y  dimension,  with  a  70-mm 
lens.  The  image  bit  depth  is  12  bit,  and  the  exposure  control  ranges  from 
10  ps  to  17.9  min.  Thus,  this  system  results  in  a  cube  of  the  hyperspectral 
image  data,  with  696  x  580  x  412  voxels  in  the  x-y  spatial  dimensions  and 
the  z  spectral  dimension,  respectively  (Fig.  1A). 

To  account  for  the  internal  noise  of  the  imaging  system,  dark  images  were 
taken  after  each  scan  and  subtracted  out  from  the  previously  acquired  ra¬ 
diance  images.  To  obtain  the  reflectance  images  for  modeling  the  chromatic 
information  from  the  predator's  view,  the  National  Institute  of  Standards 
and  Technology  Spectralon  white  standard  was  imaged  soon  after  taking 
the  radiance  images,  using  exactly  the  same  camera  settings.  The  dark- 
subtracted  Spectralon  data  cube  was  then  used  to  normalize  the  dark-sub¬ 
tracted  radiance  data  cube  and  to  derive  the  reflectance  cube.  This  process 
allows  us  to  obtain  the  reflectance  spectrum  (along  the  z  dimension)  for 
each  pixel  in  the  x-y  dimension.  To  easily  visualize  these  hyperspectral 
images,  the  ENVI  program  (a  software  commonly  used  for  processing  and 
analyzing  geospatial  imagery;  ITT  Visual  Information  Solutions)  was  used. 
Three  represented  frames  (650,  550,  and  450  nm  for  R,  G,  and  B  channels, 
respectively)  from  the  hyperspectral  images  were  selected  to  form  a  pseu¬ 
docolor  image  for  convenient  visualization.  Three  such  pseudocolor  images 
of  cuttlefish  showing  disruptive,  mottle,  and  uniform  body  patterns  on 
natural  substrates  were  illustrated  (Fig.  1  B-D ). 

Modeling  the  Predator's  View.  Although  the  details  of  visual  systems  of  cut¬ 
tlefish  predators  are  not  known  ( Serranus  cabrilla  is  the  only  fish  species 
observed  directly  to  prey  on  5.  officinalis  in  the  Mediterranean  sea)  (21,  55), 
we  chose  one  dichromatic  fish  and  one  trichromatic  fish  as  their  potential 
predators  to  simulate  their  views  of  these  camouflaged  cuttlefish.  In  di¬ 
chromatic  fish,  the  Amax  of  S  and  M  cones  was  450  and  545  nm.  In  tri¬ 
chromatic  fish,  the  Amax  of  S,  M,  and  L  cones  was  450,  530,  and  560  nm.  It 
should  be  noted  that  although  the  choice  of  these  Amax  of  dichromatic  and 
trichromatic  cones  was  arbitrary,  shifting  the  Amax  of  these  cones  up  or  down 
10-20  nm  did  not  significantly  affect  the  results. 

To  simulate  what  the  fish  predators  see  of  these  camouflaged  cuttlefish,  we 
first  computed  the  receptor  quantum  catches  for  each  pixel  of  the  HSI  images 
(35).  The  receptor  quantum  catch,  g„  in  photoreceptor  of  type  /  is  calculated  as 

q-,  =  ki  j  l(X)T(X)R (X)Sj  (A)  c/A,  [1] 

where  k,  is  an  arbitrary  scaling  factor,  A  denotes  wavelength,  /(A)  is  the  ir- 
radiance  spectrum  of  D65  (56),  T(A)  is  the  transmission  spectrum  of  coastal 
water  type  3  at  1  m  or  10  m  (36),  /?(A)  is  the  reflectance  spectrum  of  each 
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pixel  in  the  HSI  image,  5,(A)  is  the  spectral  sensitivity  of  a  receptor  /  (57),  and 
integration  is  over  the  range  369-700  nm  (Fig.  1  E-G).  The  k,-  describes  the 
von  Kries  transformation,  which  is  a  mechanism  for  color  constancy  by  in¬ 
dependent  adaptation  of  photoreceptors  (56), 


'  y(X)T(K)Rb(X)S,(k)dX’  1 2 3 4 5 6  ‘ 

where  Rb(K)  is  the  averaged  reflectance  spectrum  of  all  pixels  in  the  HSI 
image.  Following  Fechner's  law,  the  signal  of  a  receptor  channel  is  pro¬ 
portional  to  the  logarithm  of  the  quantum  catch;  thus  the  coded  quantum 
catch  Qi  in  photoreceptor  of  type  /  is  calculated  as 

0/  =  ln(qf/).  [3] 

Quantum  catch  images  of  four  different  Amax  photoreceptors  (Q450,  Q530, 
Q545,  and  Q560)  were  then  used  to  generate  composite  images  of  cuttlefish 
when  viewed  through  the  eyes  of  di-  and  trichromatic  fish  predators  (Fig. 
1 H).  These  were  formed  by  assigning  the  blue  channel  as  the  Q450  image 
and  green/red  channels  as  the  Q545  image  for  dichromatic  vision.  Similarly, 
the  trichromatic  view  was  formed  by  assigning  blue,  green,  and  red  channels 
as  the  Q450,  Q530,  and  Q560  images,  respectively  (1 6).  To  separate  the  visual 
information  in  luminance  and  chromatic  channels,  we  assumed  the  lumi¬ 
nance  signal  is  solely  from  the  M/L  cones  in  fish;  thus  the  Q545  quantum 
catch  image  (averaged  Q530  and  Q560  for  trichromatic  vision)  was  used  as 
the  monochromatic  image,  representing  the  luminance  information.  The 
chromatic  images  were  extracted  from  the  composite  images  by  removing 
luminance  information  and  thus  making  the  resultant  images  isoluminant. 
This  procedure  was  done  by  computing  the  difference  between  each 
quantum  catch  image  from  the  mean  of  the  composite  image  and  assigning 
the  corresponding  RGB  channels  accordingly  (47).  To  estimate  the  chromatic 
discriminability  (AS)  of  cuttlefish  against  background  in  the  eyes  of  preda¬ 
tors,  the  color  space  models  of  Vorobyev  and  Osorio  (35)  were  implemented. 
Details  of  the  equations  used  to  derive  AS  (i.e.,  the  JND)  are  given  in  SI 
Materials  and  Methods.  The  color  contrast  images  were  generated  by 
assigning  AS  between  each  pixel  and  averaged  background  in  the  color 
space  of  di-  and  trichromatic  predators  (16). 

Quantification  of  Body  Patterns  and  Background  Textures.  To  characterize  the 
body  patterns  of  camouflaged  cuttlefish,  the  granularity  analysis  (24,  58)  was 
applied  (5/  Materials  and  Methods).  Briefly,  the  three  major  pattern  types  of 
cuttlefish  (disruptive,  mottle,  and  uniform)  differ  in  spatial  scales  (or  gran¬ 
ularity);  thus  we  can  quantify  such  differences  by  analyzing  the  image  of  the 
animal  in  different  spatial  frequency  bands.  The  resultant  granularity  spec¬ 
trum  of  the  image  was  then  used  to  distinguish  the  body  patterns.  The 
amplitude  and  shape  of  these  curves  reflect  high/low  contrast  and  coarse/ 
fine  scale  of  the  body  patterns,  respectively.  Similarly,  the  granularity 
spectrum  of  background  texture  can  be  obtained  using  the  same  analysis. 
Processed  images  in  the  luminance  and  chromatic  channels  of  di-  and  tri¬ 
chromatic  predators  (e.g..  Fig.  2  B,  E,  and  F)  were  subjected  to  this  granularity 
analysis  for  evaluating  the  pattern  match  between  animal  and  background. 
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